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CRITieiSMS OF THE EPIDEMIOLOGIC STUDIES ON ETS AND LUNG CANCER 


Some general criticisms are applicable to the majority 
of the epidemiologic studies on ETS and lung cancer. 

strength of the association 

• Wynder and Kabat wrote in 1990: 

An association is generally considered weak if 
the odds ratio is under 3.0 and particularly 
when it is under 2.0> as is the case in the 
relationship of ETS and lung cancer. 

Such a weak association calls for special attention to possible 

sources of bias and confounding. 

Exposure bias 

• Spouses, next-of-kin or friends are sometimes asked to estimate 

the amount of ETS to which they think the subject was exposed. 

This may result in something called "exposure bias" or 

2 

"exposure misclassification." 


Exposure indices and risk estimates based on 'Uiis type of 


information may be improper and incorrect. 


One example of this was reported in the Garf inkel, et al., 
study, published in 1985, which reported relative-Hpisks of 
0.83: when 'Une cases answered questions about ETS, 0.77 when 
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the cases' husbands answered, and 3.57 when the cases" children 
answered (a copy of this study nay be found in Section A of 
this noteboQk)i. 


Reporting bias 


Another type of bias that nay arise is "reporting bias," which 

nay result if cases and controls respond differently to 

2 

questions about personal snoking and ETS exposure. 


Publication bias 


• "Publication bias" arises fron the apparent failure by 
scientific journals to publish papers reporting negative or 
weakly positive results. If this occurs, the set of ptiblishedi 
investigations nay not be truly representative of all the 

3 

studies in the area. 

Confounding factors 

* The studies did not always account for possible confounding 
factors. (This is addressed in nore detail in the section in 
this notebook on confounders.) 
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Use of questloniia Ires 


All of the epidemiologic studies on the purported association 
between ETS exposure and disease in nonsmokers rely solely upon 
questionnaires about exposure, rather than upon actual exposure 
data.^ Recent studies Indicate that questionnaires are an 
unreliable and inaccurate measure of exposure. 

Questionnaire responses about exposure vary widely when 

compared with actual measurements of ETS constituents in the 
5 

ambient air. 


Histology 


Lung cancer diagnoses were not always histologically or 
pathologically verified.^ 

Also, the histological composition, l.e., the type of lung 
cancer, differed among studies (In some studies, all 
histological types were Included; In others, some types were 
excluded).^ 
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" Data-dredaiiia* 


• Invest:igators often examine numerous s\ibgroups of the study 
population, and may report only those conclusions which fit 
with their hypothesis.^ (This is sometimes called "data- 
dredglng:."): 

Hisclassificatlon 

• If the personal smoking status of subjects is not accurately 
classified, it could result in “misclassification bias.” 

• One critic, Peter Lee, contends that the reported "risks” for 
nonsmokers are the result of bias caused by a small nximber of 
smokers who are reported in the studies as nonsmokers.^ 

Conclusion 


German scientist Karl Uberla discussed some criticisms of 
the ETS^lungi cancer studies at a recent scientific symposium in 
Argentina: 


The majority of criteria for a causal connection 
are not fulfilled. There is no consistency, 
there is a weak association, there is no 
specificity, the dose-effect relation can be 
viewed controversially, bias and confounding 
are not adequately excluded, there is no 
intervention study, significance is only present 
under special conditions and the biological- 
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plausibility can be judged controversially 


7 


The eminent statistician Nathan Mantel concluded the 


following: 


[I]t is unlikely that any epidemiological study 
has been, or can be, conducted which could 
permit establishing that the risk of lung cancer 
has been raised by passive smoking. Whether 
or not the risk is r^sed remains to be taken 
as a matter of faith. 


Copies of critical papers, highlighted in yellow for 
useful information and in blue for adverse statments, are found 
at Tabs 1-7. 
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CRITICISMS OP THE HIRAYAMA STUDY 


Numerous criticisms of the Hirayama study have beeu' 

8—21 

made. They include: 


The age distribution of the sample is not representative of the 
total Japanese population^ paxrticularly for women over the 
age of 40. When a statistical correction is made for this 
bias, the increased relative risk reported by Hirayama 
virtually disappears. 


The appropriateness of Hirayama's standardization of the data 
by husband's age, rather than by subject's, has been 
questioned. When Kilpatrick re-analyzed the data adjusted 
by subject's age, the model used by Hirayama was shown to be 
inappropriate and the reported significantly elevated risk 
associated with husband's smoking was no longer apparent. 


The Hirayama study was not designed to investigate ETS 
exposure; it is inappropriate to use it to make conclusions 
about the hypothesis of an ETS-lung cancer reliatlonship.® 


Errors and internal inconsistencies in the data and in risk 


ratios and' confidence intexvals have been noted and publicly 

13-15 


acknowledged by Hirayama. 
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use of 


• The designi of the study has been criticized, e.g., 

Q 

death certificates as evidence for lung cancer is unreliable ; 
autopsy or histology results were available for only 11.5% 
(23 of 200) of the cases ' ; use of the smoking status of 
the subject's husband as a surrogate measure for ETS exposure 
is not rellabie®'^^; many possible confounding factors were 
overlooked.® 

It api»ars that Hirayama has never adequately addressed 
the criticisms; for instance, his 1990 monograph on the study 
persists in presenting the same data analyses that have been 
particularly criticized. In addition, Hirayama has not made his 
original data available for review.®' 

A bibliography of the criticisms follows. Copies of 
selected papers are given at Tabs 8-20. They are highlighted in 
yellow for useful information and in blue for adverse statements. 
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CRITICISMS OP THE TRICHOPOULOS SITJDY 


Regarding the Trichopoulos, et al., study, the following 
criticisms have been made: 

• In 1990, Letzel and tiberla evaluated the quality of ETS-lung 
cancer studies. Based on possible sources of bias and other 
problems with study design, they concluded that the 
Trichopoulos, et al. study, in particular, is "methodologically 
unacceptable" and is "a textbook example of how a' case-control 
study should not be performed." Furthermore, they reported 
that this study may strongly influence the outcomes of meta- 
analyses of the ETS-lung cancer epidemiological studies (e.g., 
when the Trichopoulos study was included in meta-analyses of 
all possible case-control study combinations, it appeared' in 
330 of the 353 significant study combinations). 

• Methodologically, the study has been criticized' for selecting 

cases and controls from different hospitals; for excluding 

patients with adenocarcinoma and with alveolar carcinoma; 

for the lack of histological or cytological Gonfirmation in 

35% of the cases; and for its small sample size. ' According 

to Uberla, the small sample size means that "the statistically 

•significant* results of this study may well be artefacts 

23 

from chance, bias or confounding." 
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Copies of the articles referenced above, highlighted in 
yellow for useful infomation and in blue for adverse statements 
are found at Tabs 21-23. 
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